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Abstract — Ensembles of (J, K) -regular low-density parity- 
check convolutional (LDPCC) codes are known to be asymp- 
totically good, in the sense that the minimum free distance grows 
linearly with the constraint length. In this paper, we use a 
protograph-based analysis of terminated LDPCC codes to obtain 
an upper bound on the free distance growth rate of ensembles of 
periodically time-varying LDPCC codes. This bound is compared 
to a lower bound and evaluated numerically. It is found that, for 
a sufficiently large period, the bounds coincide. This approach 
is then extended to obtain bounds on the trapping set numbers, 
which define the size of the smallest, non-empty trapping sets, 
for these asymptotically good, periodically time-varying LDPCC 
code ensembles. 

I. Introduction 

||Low-density parity-check convolutional (LDPCC) codes 
0] have been shown to be capable of achieving capacity- 
approaching performance with iterative message-passing de- 
coding |2). The excellent iterative decoding thresholds 
[4 1 that these codes display has recently been attributed to the 
threshold saturation effect J5]- In addition to good threshold 
performance, it can also be shown that the minimum free 
distance typical of most members of these LDPCC code 
ensembles grows linearly with the constraint length as the 
constraint length tends to infinity, i.e., they are asymptotically 
good @. A large free distance growth rate indicates that codes 
randomly drawn from the ensemble should have a low error 
floor under maximum likelihood (ML) decoding. 

When sub-optimal decoding methods are employed, there 
are other factors that affect the performance of a code. For 
example, it has been shown that so-called 'trapping sets' are 
a significant factor affecting decoding failures of LDPC codes 
over the AWGN channel with iterative message-passing de- 
coding. Trapping sets, graphical sub-structures existing in the 
Tanner graph of LDPC codes, were first studied in Q. Known 
initially as near-codewords, they were used to analyse the 
performance of LDPC codes in the error floor, or high signal- 
to-noise ratio (SNR) region, of the bit error rate (BER) curve. 
In HI, Richardson developed these concepts and proposed a 
two-stage technique to predict the error floor performance of 
LDPC codes based on trapping sets. 

In this paper, we use a protograph-based analysis of ter- 
minated LDPCC codes to form an upper bound on the free 
distance growth rate of ensembles of periodically time-varying 
LDPCC codes. The free distance growth rate can also be 
bounded below by using ensembles of tail-biting LDPCC 
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codes |D, (TO). By comparing and evaluating these bounds we 
find that, for a sufficiently large period, the bounds coincide, 
giving us exact values for the convolutional code free distance 
growth rates. This approach is then extended to obtain bounds 
on the trapping set numbers, which define the size of the 
smallest, non-empty trapping sets, for these asymptotically 
good, periodically time-varying LDPCC code ensembles. We 
also show that the trapping set numbers grow linearly with 
constraint length. For all the ensembles considered, we find 
that the distance and trapping set growth rates exceed those 
of corresponding block code ensembles. 

II. Background 

A protograph ifTTI is a small bipartite graph that is used to 
derive a larger graph by taking an A^-fold graph cover |fl~2), or 
"lifting", of the protograph. It is an important feature of this 
construction that each lifted code inherits the degree distribu- 
tion and graph neigbourhood structure of the protograph. The 
protograph can be represented by a base biadjacency matrix 
B, where B x tV is taken to be the number of edges connecting 
variable node v y to check node c x . The parity-check matrix 
H of a protograph-based LDPC block code can be created 
by replacing each non-zero entry in B by a sum of B x>y 
permutation matrices of size N x N and each zero entry by 
the N x N all-zero matrix. The ensemble of protograph-based 
LDPC block codes with block length n = Nn v is defined 
by the set of matrices H that can be derived from a given 
protograph by choosing all possible combinations of N x N 
permutation matrices. 

A. Convolutional protographs 

An ensemble of unterminated LDPCC codes can be de- 
scribed by a convolutional protograph Q with base matrix 
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where m s denotes the syndrome former memory of the 
convolutional codes and the b c x b v component base matrices 
B^ i = 0, . . . , m s , represent the edge connections from 
the b v variable nodes at time t to the b c check nodes 
at time t + i. An ensemble of (in general) time-varying 
LDPCC codes can then be formed from B[ oo ] using the 



protograph construction method described above, resulting in 
the associated parity-check matrix 
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A rate R = 1 - Nb c /Nb v = 1 - b c /b v time-varying LDPCC 
code with parity-check matrix Hmod is periodically 
time-varying with period T if Hi(t) is periodic, i.e., 
Ui(t) = Hi(t + T),V i,t, and if Hj(i) = H 4 ,V i,t, the code 
is tune-invariant. We call zv s = N(m s + l)b v the decoding 
constraint length. 

Starting from the base matrix B of a block code ensemble, 
one can construct LDPCC code ensembles with the same 
computation trees. This is achieved by an edge spreading 
procedure (see |4] for details) that divides the edges from each 
variable node in the base matrix B among m s + 1 component 
base matrices B^, i = 0, ...,m s , such that the condition 
Bo + Bi + • ■ • + B ms = B is satisfied. For example, a (3,6)- 
regular LDPCC ensemble with m s = 2 can be formed from 
the block base matrix B = [ 3 3 ] by defining the component 
base matrices Bo = [ 1 1 ] = Bi = Bg . 

III. Termination of LDPCC codes 

Suppose that we start the convolutional code with parity- 
check matrix defined in ([TJ at time t = and terminate it 
after L time instants. The resulting finite-length base matrix 
is then given by 
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[0,-L-l] 
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The matrix Hm l-i] can be considered as the base matrix 
of a terminated protograph-based LDPCC code ensemble. 
Termination in this fashion results in a rate loss. The design 
rate of the terminated code ensemble is given as 

where R = 1 — Nb c /Nb v = 1 — b c /b v is the rate of 
the unterminated convolutional code ensemble. Note that, as 
the termination factor L increases, the rate increases and 
approaches the rate of the unterminated convolutional code 
ensemble. 

The convolutional base matrix Br oo ] can also be termi- 
nated using tail-biting fPHl . fl4l . Here, for any A > m s , 
the last b c m s rows of the terminated parity-check matrix 



IV. Free distance analysis of protograph-based 
LDPCC codes 

From a convolutional protograph with base matrix Bfo )00 ], 
we can form a periodically time-varying TV-fold graph cover 
with period T by choosing, for the b c x b v submatrices 
Bo, Bi, . . . , B TOs in the first T columns of Br 0)OO i, a set of 
N x N permutation matrices randomly and independently to 
form Nb c x Nb v submatrices H (t), H x (t + 1), . . . , H m ,(i + 
m 8 ), respectively, for t = 0, 1, . . . ,T — 1. These submatrices 
are then repeated periodically (indefinitely) to form H[o !00 ] 
such that H,(i + T) = H,(t), Vi,t. An ensemble of pe- 
riodically time-varying LDPCC codes with period T, rate 
R = 1 — Nb c /Nb v = l — b c /b v , and decoding constraint length 
v s = N(m s + l)b v can then be derived by letting the permuta- 
tion matrices used to form Ho (t), Hi(t+1), . . . , H m , (t+m s ), 
for t = 0, 1, . . . , T— 1, vary over the AH choices of permutation 
matrix. 

A. Free distance bounds for LDPCC code ensembles 

Consider an ensemble of periodically time-varying LDPCC 
codes with rate R = 1 — b c /b v and period T constructed 
from a convolutional protograph with base matrix B[ 0jO o] as 
described above. It is known that the average free distance of 
this ensemble can be bounded below by the average minimum 
distance of an ensemble of tail-biting LDPCC codes derived 



T 



from the base matrix b[^ with termination factor A 
10, iflOl . Here, we show that the average free distance of 
the convolutional ensemble can also be bounded above by 
the average minimum distance of the ensemble of terminated 
protograph-based LDPCC codes derived from the base matrix 
B[o.l-i] w i m termination factor L = T. 

Theorem 1: Consider a rate R = 1 — b c /b v unterminated, 
periodically time-varying LDPCC code ensemble with mem- 
ory m s , decoding constraint length v s = N(m s + l)b v , and 

period T derived from Br 0iOO i. Let d^ in be the average mini- 
mum distance of the terminated convolutional code ensemble 
with block length n = LNb v and termination factor L. Then 

— (T) 

the ensemble average free distance df ree of the unterminated 

convolutional code ensemble is bounded above by <£^ in for 
termination factor L = T, i.e., 



-l{T) -r(T) 
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Sketch of proof. There is a one-to-one relationship be- 
tween members of the periodically time- varying LDPCC 
code ensemble and members of the corresponding ter- 
minated LDPCC code ensemble with termination factor 
L = T. For any such pair of codes, every code- 
word x = [ xq x\ ■■• XLNb v -i ] in the terminated 
code can immediately be seen as a codeword xr oo ] = 
[ xq x\ ■•■ x LNb -l ••• ] in the unterminated 

(T) 



[0,A-1] 



are removed and added to the first b c m s rows code. It follows that the free distance d} ? 4 of the unterminated 
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to form the \b c x \b v tail-biting parity-check matrix B th 
with tail-biting termination factor A. Terminating B[o i00 i in 
such a way preserves the design rate of the ensemble, i.e., 
R\ = 1 — Xb c /Xb v = 1 — b c /b v = R, and we see that B^ 
has exactly the same degree distribution as the original block 
base matrix B. 



of the 



(T) 

code can not be larger than the minimum distance d m ( n 

terminated code. The ensemble average result d^J ee < d^ in 
then follows directly. □ 
Since there is no danger of ambiguity, we will henceforth 
drop the overline notation when discussing ensemble average 
distances. 



B. Free distance growth rates of LDPCC code ensembles 

In |fl5l , Divsalar presented a technique to calculate the 
average weight enumerator for protograph-based block code 
ensembles. This weight enumerator can be used to test if the 
ensemble is asymptotically good, i.e., if the minimum distance 
typical of most members of the ensemble is at least as large 
as 8 m i n n, where 5 m i n its the minimum distance growth rate 
of the ensemble and n is the block length. 

For LDPC convolutional codes, conventionally defined as 
the null space of a sparse parity-check matrix Hr 0jOO i, it is 
natural to define the free distance growth rate with respect 
to the decoding constraint length u s , i.e., as the ratio of the 
free distance df ree to the decoding constraint length jAjQ By 
bounding d^) ee using (|4j, we obtain an upper bound on the 
free distance growth rate as 



Terminated minimum 
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where 8, 



IT) 



d^L/n = dZl/{NTb v ) is the minimum 
distance growth rate of the terminated LDPCC code ensemble 
with termination factor L = T and base matrix B[ O .t-i]0 
Similarly, it was shown in [9| that 



l(T) rji 



f ree ~ (m s + 1) ' 



(6) 



where 8 m l n is the minimum distance growth rate of the 
tail-biting LDPCC code ensemble with tail-biting termination 



(A) 
tb ■ 



factor A = T and base matrix B 

C. Numerical results 

As an example, we consider the (3, 6)-regular LDPCC code 
ensemble defined in Section IH-AI Since the unterminated 
convolutional code has rate R = 1/2, we calculate the upper 
bound on the free distance of the periodically time-varying 
LDPCC code ensemble as 5f r \ e < 6%)t/3 using © for 
termination factors L = T > 3. Figure Q] displays the mini- 
mum distance growth rates 5^} n of the terminated ensembles 
defined by B[ .£-i] for L = 3, 4, . . . , 21 that were calculated 
using the technique proposed in ffT31 and the associated upper 
bounds on the convolutional growth rate Sf ree < 8 m l n T/3 
for L = T. Also shown are the minimum distance growth 
rates 5^j n of the tail-biting ensembles defined by base matrix 
b|^ ' for A = 3, 4, . . . , 21 and the associated lower bounds on 
the convolutional growth rate 8f ree > for A = T 

calculated using ([6j. 

We observe that the calculated ensemble tail-biting con- 
volutional code minimum distance growth rates 6^ n remain 
constant for A = 3, . . . , 11 and then start to decrease as the 
termination factor A grows, tending to zero as A tends to 
infinity. Correspondingly, as A exceeds 11, the lower bound 

'The free distance growth rate may also be calculated with respect to the 
encoding constraint length u e , which corresponds to the maximum number 
of transmitted symbols that can be affect ed b y a single nonzero block of 
information digits. For further details, see 11161 . 

2 The free distance growth rate 8p^ ee that we bound from above using l(5j, 
by definition, is an existence-type lower bound on the free distance of most 
members of the ensemble, i.e., with high probability a randomly chosen code 
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Fig. 1 : Minimum distance growth rates of terminated and tail-biting LDPCC 
code ensembles with calculated upper and lower bounds on the free distance 
growth rate of the associated periodically time-varying LDPCC code ensem- 
bles. 

calculated for 6 f '„ levels off at 8 \ ' > 0.086. The calculated 

JTGG JV&c 

terminated convolutional code minimum distance growth rates 
^mli are larg 6 f° r small values of L (where the rate loss 
is larger) and decrease monotonically to zero as L — > oo. 
Using (|5]l to obtain an upper bound on the free distance 
growth rate we observe that, for T > 12, the upper and lower 
bounds on 5^) ee coincide, indicating that, for these values 

of the period T, 8^} ee = 0.086, significantly larger than the 
(3, 6)-regular LDPC block code minimum distance growth rate 
8 m in = 0.023. In addition, we note that at the point where 
the bounds coincide, the growth rates for both termination 
methods also coincide. Recall that the tail-biting ensembles 
all have rate 1/2, wheras the rate of the terminated ensembles 
is a function of the termination factor L given by (©. 

Lower bounds on the free distance growth rates were 
calculated for a wide variety of (J, X)-regular and irregular 
LDPCC code ensembles in ATI . Using the technique detailed 
here, we can form upper bounds on the free distance growth 
rate that coincide numerically for sufficiently large T, giving 
us exact free distance growth rates. For example, we can bound 
the convolutional free distance growth rate of the (4, 8) -regular 



ensemble as 0.1908 < 6 



(T) 
free 



< 0.1908 and the free distance 



growth rate for the rate R = 2/3, (3, 9)-regular ensemble 
as 0.0186 < S f H e < 0.0186 for sufficiently large T (again 
significantly larger than the corresponding block growth rates, 
see ifTSl ). This general technique can be used to bound the 
free distance growth rate above and below for any regular or 
irregular periodically time- varying protograph-based LDPCC 
code ensemble. 

V. Trapping set analysis of LDPCC codes 

In 0, MacKay and Postol discovered a "weakness" in 
the structure of the Margulis construction of a (3, 6)-regular 
Gallager code. Described as near-codewords, these small 
graphical sub-structures existing in the Tanner graph of LDPC 
codes cause the iterative decoding algorithm to get trapped in 
error patterns. These weaknesses were shown to contribute 
significantly to the performance of the code in the error floor 



region of the BER curve. Richardson developed this concept 
in [8] and defined these structures as trapping sets. 

Definition 1: An (a, b) general trapping set r b of a bipar- 
tite graph is a set of variable nodes of size a which induce 
a subgraph with exactly b odd-degree check nodes (and an 
arbitrary number of even-degree check nodes). 

In order to calculate ensemble average general trapping set 
enumerators for protograph-based LDPC block code ensem- 
bles, we use the combinatorial arguments previously presented 
in lfl8l . The technique involves considering a two-part en- 
semble average weight enumerator for a modified protograph 
with the property that any (a, b) trapping set in the original 
protograph is a codeword in the modified protograph. 

A. Trapping set growth rates 

Let A = b/a = (3/a, where a = a/n, j3 = b/n, and 
A G [0,oo). As proposed in ifTHl . we classify the trapping 
sets as ta = {i"a,&|fr = Aa}. For each A, we define d ts (A) 
to be the A-trapping set number, which is the size of the 
smallest, non-empty trapping set in ta. The two-part average 
ensemble average weight distribution can be used to test if 
the ensemble has the desirable property that the A-trapping 
set number increases linearly with block length n |[T8l . If this 
is the case, we can say that, with high probability, a randomly 
chosen code from the ensemble has a A-trapping set number 
that is at least as large as n<$t s (A), where St s (A) is called the 
A-trapping set growth rate of the ensemble. If this is true for 
all A > 0, this implies that, for sufficiently large n, a typical 
member of the ensemble has no small trapping sets. 

B. Trapping set bounds for protograph-based LDPCC code 
ensembles 

Consider once more the ensemble of periodically time- 
varying of LDPCC codes with rate R = 1 — b c /b v and period 
T derived from a convolutional base matrix B[o !00 ] and the 
associated terminated LDPCC code ensemble with base matrix 
B |0 ,i-i] and L = T. 

Theorem 2: Consider a rate R = 1 — b c /b v unterminated, 
periodically time-varying convolutional code ensemble with 
memory m s , decoding constraint length v s = N(m s + l)b v , 

and period T derived from B[ 0jOO ]. Let d\ s ^ (A) be the average 
A-trapping set number of the terminated convolutional code 
ensemble with block length n = LNb v and termination factor 

— (T) 

L. Then the ensemble average A-trapping set number d cc4s (A) 
of the unterminated convolutional code is bounded above by 

d ts \a) for termination factor L = T and any A > 0, i.e., 



l(T) 



4^ fl (A)<di s '(A) VA>0. 



(7) 



Sketch of proof. The proof is a straightforward generalisa- 
tion of the proof of Theorem 1. We first show that, for 
any periodically time-varying LDPCC code and associated 
terminated LDPCC code with termination factor L = T, 
and any A > 0, any (a, Aa) general trapping set in the 
terminated code is also an (a, Aa) general trapping set in 
the convolutional code, i.e., the A-trapping set number of 
the convolutional code d c J s (A) is bounded above by the A- 
trapping set number of the terminated code a£j' (A) for L = T 
and any A > 0. This can be shown by considering a pair of 
modified code ensembles where each check node is connected 
once to a distinct auxiliary variable node (see lfl8l ). Crucially, 



there is a bijective mapping from the set of all (a, fe)-general 
trapping sets in the original code to the set of all codewords 
in the modified code, and we can use a minimum distance- 
type argument to prove the result for the modified code. The 

— (T) —(T) 

ensemble average result d c J s (A) < d ts (A) for all A > 
then follows directly. □ 
Again, we will henceforth drop the overline notation when 
discussing ensemble average A-trapping set enumerators. Us- 
ing (0 and a similar sequence of arguments to those presented 
in Section IIV-B1 we can form an upper bound on the A- 
trapping set growth rate S^ S (A) of the periodically time- 
varying LDPCC code ensemble as 

d(A) 



6 (T) 



(A) 



< 



4 T) (A)T 



1) 



(8) 



where 8^\A) is the A-trapping set growth rate of the 
terminated LDPCC code ensemble with termination factor 
L = T and base matrix B[ .t-i] for any A > 0. Similarly, 

a lower bound on S^ S (A) was calculated in lfl9l using tail- 
biting LDPCC code ensembles as 



AT) 



(A)> 



4 T) (A)r 

(m, + 1) ' 



(9) 



where S^P (A) is the A-trapping set growth rate of the tail- 
bitina LDPCC code ensemble with termination factor A = T 

(T) 

and base matrix BJ & for any A > 0. 

C. Numerical results 

We continue our analysis of the (3, 6)-regular LDPCC 
code ensemble described in Section III-AI Since the unter- 
minated convolutional code has rate R = 1/2, we cal- 
culate the upper bound on the A-trapping set growth rate 
of the periodically time-varying LDPCC code ensemble as 
^crfl(A) < <5 t ( J ) (A)T/(m s + 1) using ® for termination 
factors L = T > 3. For A = 0,0.01,0.05, Figure E] displays 
the A-trapping set growth rates 5].J (A) of the terminated 
ensembles defined by Bj l-i] f° r L = 3, ... ,18 (calculated 
using techniques from IU8I ) and the associated upper bounds 
on the convolutional A-trapping set growth rate 6^ S (A) for 
L = T. Also shown are the A-trapping set growth rates 



JjJ^A) of the tail-biting ensembles defined by B^ ; for 
A = 3,6, ...,18 and the associated lower bounds on the 
convolutional growth rates S^ S (A) calculated using © that 



(A) 



were obtained in 11191 . 

Note that setting A = (3/a = corresponds to the 
minimum distance growth rate problem discussed in Section 
IIVI and as a result, the curves corresponding to A = match 
those displayed in Figure Q] For A = 0.01 and A = 0.05 
we observe the same behaviour: the A-trapping set growth 
rates of the LDPC block code ensembles defined by B[ 

(T) ' 

and W tb are positive and decrease monotonically to zero 
as the termination factors tend to infinity. For each A, the 
corresponding upper and lower bounds calculated for 5 cct : s (A) 
using ([S]) and © (respectively) coincide for T > 12 and 
decrease as A increases. The empirical data suggests that the 
bounds will remain equal and constant for T > 18. 

As A ranges from to 00, the points (8 ts (A), ASt s (A)) 
trace out the so-called zero-contour curve for a protograph- 
based block code ensemble lfl8l . The zero-contour curves 




Termination factor (k or L) and period T 



Fig. 2: A-trapping set growth rates of terminated and tail-biting LDPCC 
code ensembles with calculated upper and lower bounds on the A-trapping 
set growth rate of the associated periodically time-varying LDPCC code 
ensembles. 

for the (3, 6)-regular LDPC block code ensemble and the 
periodically time-varing LDPCC code ensemble with T = 12 
are shown in Figure 130 The A-trapping set growth rates are 
highlighted for A = 0.01. 

For all A > 0, S^l(A) > 0, indicating that, for each 
class of (a, b) general trapping set, the size of the small- 
est non-empty trapping set typical of most members of the 
ensemble is growing linearly with constraint length. Code 
ensembles with large A-trapping set numbers d c( J s (A) are the 
most interesting, since small trapping sets dominate iterative 
decoding performance in the error floor 08] ■ Thus we want 

( 12) 

the A-trapping set growth rate ^ cfs '(A) to exist and to be as 
large as possible, thus guaranteeing good iterative decoding 
performance in the error floor. Finally, we note that the 

(12) 

convolutional growth rate 8 cct ^(A) exceeds the associated 
block growth rate 5 ts (A) for all A > 0. 

VI. Conclusions 

In this paper we showed, using a protograph-based analysis 
of terminated LDPCC codes, that we can obtain an upper 
bound on the free distance growth rate of an ensemble of 
periodically time-varying LDPCC codes. We found that the 
bounds we obtain coincide with lower bounds previously 
obtained by analysing the minimum distance of ensembles of 
tail-biting LDPCC codes. This approach was then extended to 
obtain upper and lower bounds on the A-trapping set growth 
rates of ensembles of periodically time-varying LDPCC codes. 
Further, it was shown that the distance and A-trapping set 
growth rates of the LDPCC code ensembles exceed the growth 
rates of the corresponding LDPC block code ensembles on 
which they are based. The large minimum distance and trap- 
ping set growth rates obtained suggest that LDPCC codes will 
exhibit good iterative decoding performance in the error floor. 

3 For T = 12, the upper and lower bounds coincide for all calculated values 
of A. This enables us to plot an exact zero- cont our curve, in contrast to the 
lower-bound zero-contour curve reported in 11191 . 
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Fig. 3: Zero-contour curves of the (3, 6)-regular LDPC block code ensemble 
and the (3, 6) -regular LDPCC code ensemble. 
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